EVALUATION 


and PROGRAM PLANNING 


CONTENTS AND AUTHOR INDEX 
VOLUME 21, 1998 


Pergamon 


2.6 


EVALUATION AND PROGRAM PLANNING 


Website: http:// wwwelsevier.nl/locate/evalprogplan/ 


EDITOR-IN-CHIEF: Jonathan A. Morell, 
ERIM-Centre for Electronic Commerce, 3600 Green Court, Suite 550, Ann Arbor, Michigan 48105, USA 
Mailing address: P.O. Box 134001, Ann Arbor, MI 48113-4001, USA 


EDITORIAL BOARD 


GARY L. BOWEN, 
Professor, School of Social Work, 
The University of North Carolina at Chapel Hill 


GERALD M. BRITAN, 
Senior Evaluation Analyst, Agency for International 
Development, Washington, DC 


HUEY T. CHEN, 
Department of Sociology, The University of Akron 


DAVID CORDRAY, 


Department of Human Resources, Vanderbilt University 


DEBRA A. DAROSA, 
Northwestern University 


DANIEL B. FISHMAN, 
Graduate School of Applied and Professional 
Psychology, Rutgers University 
JAMES H. FREY, 
Department of Sociology, University of 
Las Vegas, Nevada 


JOHN G. HEILMAN, 
College of Liberal Arts, Auburn University 


MICHAEL H. KEAN, 
VP for Public and Governmental Affairs, CTB 
Macmillan/ McGraw-Hill 


HENRY LEVIN, 
Professor of Education and Economics, 
Stanford University 


MARK W. LIPSEY, 
Vanderbilt University 


MAHESH S. PATEL, 
UNICEF Eastern and Southern Africa Regional Office 
Nairobi, New York 
RUDOLF H. MOOS, 
Social Ecology Laboratory, Department of Psychiatry 
and Behavioral Sciences, Stanford University 
CAROL T. MOWBRAY, 
School of Social Work, University of Michigan 
LARRY ORR, 
Senior Economist, Abt Associates 
DENNIS PALUMBO, 
Regents Professor of Justice Studies and Political 
Science, Arizona State University 
NICK L. SMITH, 
School of Education at Syracuse University 
LONNIE R. SNOWDEN, 
Institute for Mental Health Services Research, 
University of California, Berkeley 
RICHARD C. SONNICHSEN, 
Evaluation Consultant, Sandpoint, ID 
HANS TORVATN, 
The Foundation for Scientific and Industrial Research at 
the Norwegian Institute of Technology, Trondheim 
TONY TRIPODI, 
College of Social Work, The Ohio State University 
JOSEPH S. WHOLEY, 
University of Southern California, Washington 
Public Affairs Center 
JACK ZUSMAN, 
Professor of Psychiatry, Director, Florida Mental Health 
Institute, University of South Florida, Tampa 


Founding Editors: Jonathan A. Morell and Eugenie Walsh Flaherty 


Author Service Department 
For queries relating to the general submission of articles (including electronic text and artwork) and the status of accepted 
manuscripts, please contact the Author Service Department; e-mai/: authors(@elsevier.co.uk; 
Fax +44 (0) 1865 843905; Tel. +44 (0) 1865 843900. 
Frequency: Published Quarterly in February, May, August and November 


Subscription Rates 
Annual Institutional Subscription Rates 1999: Europe, the CIS and Japan, NLG 1021.00; all other countries US$518.00. 
Associated Personal Subscription rates are available on request for those whose institutions are library subscribers. Dutch 
Guilder prices exclude VAT. Non-VAT registered customers in the European Community will be charged the appropriate 
VAT in addition to the price listed. Prices include postage and insurance and are subject to change without notice. 


© 1999 Elsevier Science Ltd 


PERIODICALS postage paid at RAHWAY, NEW JERSEY. Evaluation and Program Planning (ISSN 0149-7189) is published 
quarterly in February, May, August and November by Elsevier Science Ltd, The Boulevard, Langford Lane, Kidlington, 
Oxford OX5 1GB, U.K. The annual subscription in the U.S.A. is $518. Evaluation and Program Planning is distributed by 
Mercury Airfreight International Ltd, 365 Blair Road, Avenel, NJ 07001, U.S.A. Postmaster: Please send address corrections 


to Evaluation and Program Planning, c/o Elsevier Science Regional Sales Office, Customer Support Department, 655 Avenue of 
the Americas, New York, NY 10010, U.S.A. 


= 
is 


PERGAMON 


Evaluation and Program Planning 22 (1999) V-III 


EVALUATION 


and PROGRAM PLANNING 


CONTENTS INDEX 
VOLUME 21, 1998 


Volume 21, Number | 


February 1998 


CONTENTS 


ARTICLES OF GENERAL INTEREST 


Yih-Ing Hser 

_ Judith A. Stein 
Margaret L. Polinsky 
Margaret A. Maglione 


Rivka Savaya 


Rita G. O’Sullivan 
John M. O’Sullivan 


Susan Harrington Godley 
Elisa Mustari Fielder 
Rodney R. Funk 


E. Warren Lambert 
Ann Maria Brannan 
Carolyn Breda 

Craig Anne Heflinger 
Leonard Bickman 


Carol T. Mowbray 
Deborah Bybee 
Mary E. Collins 
Phyllis Levine 


Stephen F. Seninger 


Gisela Negron-Velasquez 
Margarita Alegria 
Mildred Vera 

Daniel H. Freeman 


R. Burke Johnson 


Lena Lundgren 
Bruce Rankin 


l 


1] 


21 


31 


47 


59 


73 


81 


93 
111 


Predicting Perceived Quality of Drug Treatment Programs Using 
Latent Variable Models 


The Potential and Utilization of an Integrated Information 
System at a Family and Marriage Counselling Agency in Israel 


Evaluation Voices: Promoting Evaluation From Within Pro- 
grams Through Collaboration 


Consumer Satisfaction of Parents and Their Children With 
Child/Adolescent Mental Health Services 


Common Patterns of Service Use in Children’s Mental Health 


Optimizing Evaluation Quality and Utility Under Resource 
Constraints 


Evaluating Participation and Employment Outcomes in a 
Welfare-to-Work Program 


Testing the Service Satisfaction Scale in Puerto Rico 


Toward a Theoretical Model of Evaluation Utilization 


What Matters More: The Job Training Program or the Back- 
ground of the Participant? An HLM Analysis of the Influence of 
Program and Client Characteristics on the Wages of Inner-City 
Youth Who Have Completed JTPA Job Training 


4 

‘ 


Vi 


Charles S. Reichardt 
Lucy J. Miller 


Hallie Preskill 


Volume 21, Number 2 


SPECIAL SECTION: NEW ASSESSMENT METHODS IN MATHEMATICS: 
COMPARING AND CONTRASTING STYLES AND OUTCOMES 


Leone Burton 


Jo Boaler 
Inger Wistedt 


Wolff-Michael Roth 


Richard J. Shavelson 
Guillermo Solano-Flores 
Maria Araceli Ruiz-Primo 


Anthony W. Bartley 


Index to Volume 21, 1998 
BOOK REVIEWS 


121 Randomized Experiments for Planning and Evaluation: A 
Practical Guide 


123 Utilization-Focused Evaluation: The New Century Text 


I Issue Contributors 


May 1998 


CONTENTS 


127 Introduction to Special Section 


129 Alternative Approaches to Teaching, Learning and Assessing 
Mathematics 


143 Assessing Student Learning in Gender Inclusive Tertiary Mathe- 
matics and Physics Education 


155 Situated Cognition and Assessment of Competence in Science 


171 Toward a Science Performance Assessment Technology 


185 New Assessment Methods in Mathematics and Science: Compar- 
ing and Contrasting Styles and Outcomes 


ARTICLES OF GENERAL INTEREST 


Jack McKillip 
Caryl Cox 


Joan Fitzgerald 
Janice Matthews Rasheed 


Harold F. Goldsmith 
Charles E. Holzer III 
Ronald W. Manderscheid 


Michael T. French 
Laura J. Dunlap 
Gary A. Zarkin 
Georgia T. Karuntzos 


Michael Hendricks 


191 Strengthening the Criterion-Related Validity of Professional 
Certifications 


199 Salvaging an Evaluation From the Swampy Lowland 


211 Neighbourhood Characteristics and Mental Illness 


277 The Costs of an Enhanced Employee Assistance Program (EAP) 
Intervention 


BOOK REVIEWS 


237 Evaluation for the 21st Century: A Handbook 


‘ 
| 

| 

4 
! 
ane 


William A. Hargreaves 


M. Powell Lawton 


Volume 21, Number 3 


Index to Volume 21, 1998 Vil 


Evaluating Treatment Environments: The Quality of Psychiatric 
and Substance Abuse Programs 


Evaluating Residential Facilities 


Issue Contributors 


August 1998 


CONTENTS 


ARTICLES OF GENERAL INTEREST 


E. J. Posavac 


M. K. Smith 


L. Bickman 

E. W. Lambert 
M. Karver 

A. R. Andrade 


R. J. Calsyn 
L. A. Roades 
W. D. Klinkenberg 


L. M. Sanders 
C. Trinh 

B. R. Sherman 
S. M. Banks 


T. Trauer 


G. E. Fryer, Jr. 
C. P. Vojir 

C. Stine 

T. Miyoshi 

J. Drisko 

V. A. Harris 
M. E. Miller 


John M. Owen 
P. R. Brandon 
R. H. Heck 


J. Bradley Cousins 
Colla J. MacDonald 


243 


255 


263 


277 


287 


297 


307 


315 


323 


333 


Toward More Informative Uses of Statistics: Alternatives for 
Program Evaluators 


Empowerment Evaluation: Theoretical and Methodological 
Considerations 


Two Low-Cost Measures of Child and Adolescent Functioning 
for Services Research 


Using Theory to Design Needs Assessment Studies of the Elderly 


Assessment of Client Satisfaction in a Peer Counseling Substance 
Abuse Treatment Program for Pregnant and Postpartum Women 


A Study of Health Perceptions in Clients of a Mobile Support 
and Treatment Service for the Severely Mentally III 


Personal and Educational Background Predictors of Physician 
Practice Profiles: The Case of Colorado 


Towards an Outcomes Hierarchy for Professional University 
Programs 


The Use of Teacher Expertise in Decision Making During 
School-Conducted Needs Assessments: A Multilevel Perspective 


Conceptualizing the Successful Product Development Project as a 
Basis for Evaluating Management Training in Technology-Based 
Companies: A Participatory Concept Mapping Application 


7 


Vill 


Ray C. Rist 


Volume 21, Number 4 


345 
I 


Index to Volume 21, 1998 


BOOK REVIEWS 


Public Policy and Program Evaluation 


Issue Contributors 


November 1998 


CONTENTS 


SPECIAL ISSUE ON EVALUATION PRACTICE IN AN INTERNATIONAL DEVELOPMENT 
AGENCY: EXAMPLES FROM UNICEF 


Mahesh Patel 


Noreen Prendiville 


E. Wyss 
B. Whitney 
M. Betts 


Alix McNamara 
Nguyen Thi Thanh Nga 


Luc Chauvin 
James Mugaju 
Jondoh Comlavi 


Herve Peériés 
Carel de Rooy 
Yin Yin Nwe 


Martin S. Alilio 
Helena Eversole 
Jane Bammek 


Keith Wright 


Charlotte Schiander Gray 


E. Morah 
S. Mebrathu 
K. Sebhatu 


347 
353 


363 


377 


385 


393 


409 


415 


429 


Interesting UNICEF Evaluations—Introduction and Overview 


The Role and Effectiveness of Traditional Birth Attendants in 
Somalia 


The Promotion of Participatory Methods for Group Events in 
Zambia: a Process Evaluation Report for UNICEF 1994-1997 


Income Generation and Facts for Life Communication in 
Vietnam 


Evaluation of the Psychosocial Trauma Recovery Programme in 
Rwanda 


Monitoring and Evaluation of Guinea Worm Eradication 


A KAP Study on Malaria in Zanzibar: Implications for 
Prevention and Control. A Study Conducted for UNICEF Sub- 
Office Zanzibar 


An Assessment of the Importance of Process in the Development 
of Communications Materials in Uganda 


A Case History Based Assessment of Female Genital Mutiliation 
in Sudan 


Evaluation of the Orphans Reunification Project in Eritrea 


Issue Contributors 


| 
es, 
* 


FEFEEEE 


EFF 
Fr 


